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ABSTRACT 

In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP's 
history, voluntary state-by- state assessments were made. In 1992, the NAEP 
Program included an expanded TSA in fourth-grade reading. The 1992 reading 
assessment considered students ' performance in situations that involved 
reading different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Idaho, 2,674 students in 115 
public schools were assessed. This report describes the reading proficiency 
of Idaho fourth-graders and compares their overall performance to students in 
the West region of the United States and the nation (using data from the NAEP 
national assessments) . The distribution of reading results and reading 
achievement level results are provided for subpopulations of students 
(race/ethnicity, type of location, parents' educational level, and gender, 
and performance according to purpose for reading) . To provide a context for 
the assessment data, participating public school students, their reading 
teachers, and principals completed questionnaires which focused on: policies 
and practices related to reading (time for instructional activities and 
instructional resources for reading) ; delivery of reading instruction 
(instructional materials and activities, workbooks /worksheets /writing, 
discussion and group activities, time to read, reading and use of libraries, 
assessing progress in reading) ; reading instructors (preparation, experience 
and professional development); students' home support for literacy (reading 
outside of school and in the home and hours of television watched per day) . 
The average reading proficien cy of fourt h-grade public school students in 
Idaho on the NAEP reading scaLe was 221 compared t<5 216 'irdtiuriwiide . (SR) 
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What is The Natiom’s Report Card ? 



THE NATION S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing assessment 
of what America s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in reading, mathematics, 
science, writing, history/geography, and other fields. By making objective information on student performance available to policymakers at the national, 
state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. Only information related to academic 
achievement is collected under this program. NAEP guarantees the privacy of individual students and their families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The Commissioner of 
Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organizations. NAEP reports directly 
to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and solicitation of public comment, on NAEP’s 
conduct and usefulness. 

In 1988, Congress created the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The board is responsible for 
selecting the subject areas to be assessed, which may include adding to those specified by Congress; identifying appropriate achievement goals for each age 
and grade; developing assessment objectives; developing test specifications; designing the assessment methodology; developing guidelines and standards 
for data analysis and for reporting and disseminating results; developing standards and procedures for interstate, regional, and national comparisons; improving 
the form and use of the National Assessment; and ensuring that all items selected for use in the National Assessment are free from racial, cultural, gender, 
or regional bias. 
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INTRODUCTION 




Trial Slate Aeteesment 



The National Assessment of Educational Progress (NAEP) is a Congressionally mandated 
project of the National Center for Education Statistics (NCES) that has collected and 
reported information for nearly 25 years on what American students know and what they 
can do. It is the nation’s only ongoing, comparable, and representative assessment of 
student achievement. Its assessments are given to scientifically selected samples of youths 
attending both public and private schools and enrolled in grades four, eight, or twelve. The 
assessment questions are written around a framework prepared for each content area — 
reading, writing, mathematics, science, and others — that represents the consensus of groups 
of curriculum experts, educators, members of the general public, and user groups on what 
should be covered on such an assessment. Reporting includes means and distributions of 
scores, as well as more descriptive information about the meaning of the data. 



New Reading Assessment Framework and Questions 



The goal of the National Center for Education Statistics is to make data available for the 
public and to do so in accurate and understandable ways that are not misleading. The task 
is challenging because much of what matters in NAEP is changing: 

j 

• the content in response to the developing standards of various curricular 
groups; 

• the assessment questions in response to new developments in assessments; 
and 

• the reporting in response to increasing interest in student achievement 
relative to standards of student performance. 
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Idaho 



The framework for the 1992 Trial State Assessment Program in reading considered 
students’ performance in situations that involved reading different kinds of materials for 
different purposes. The fourth-grade reading assessment measured two global purposes for 
reading — reading for literary experience and reading to gain information. (The eighth- and 
twelfth-grade national NAEP reading assessments also measured a third purpose for 
reading — reading to perform a task.) Reading for literary experience usually involves the 
reading of novels, short stories, plays, and essays. In these reading situations, the reader 
can determine how the author explores or uncovers experiences through the text and 
considers the interplay among events, emotions, and possibilities. Reading to gain 
information usually involves the reading of articles in magazines and newspapers, chapters 
in a textbook,! entries in encyclopedias and catalogs, and entire books on particular topics. 
These reading situations call for different orientations to text from those in reading for 
literary experience because readers are specifically focused on acquiring information. 

The assessment asks students to build, extend, and examine text meaning from four stances 
or orientations: 

• Initial Understanding -- comprehending the overall or general meaning of 
the selection. 

• Developing an Interpretation - extending the ideas in the text by making 
inferences and connections. 

• Personal Response - making explicit connections between ideas in the text 
and a student’s own background knowledge and experiences. 

• Critical Stance - considering how the author crafted a text. 

These stances are not considered hierarchical or completely independent of each other, but 
are iterative. They provide a frame for generating questions and considering student 
performance at all levels. 

The 1992 NAEP reading assessment uses a variety of innovative assessment approaches 
that are considered significant advancements over previous assessments. In addition to 
multiple-choice questions, the assessment primarily includes constructed-response 
questions that ask students to demonstrate comprehension beyond a surface level. Also, 
longer and naturally-occurring reading materials are used to provide more realistic reading 
experiences than in previous assessments. 

Taken together, the changes in the 1992 reading framework and assessment activities 
preclude any comparisons between the results in this report and those for previous NAEP 
reading assessments. If the current NAEP framework is used in the future, as planned in 
the 1994 assessment, the 1992 reading data will supply the basis for a trend report. 
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A Transition in Reporting 

Over time there have been many changes in emphasis of NAEP reporting, both to take 



for NAEP similar to those the public was accustomed to seeing for the annual Scholastic 
Aptitude Test (SAT). Educational Testing Service, in its role as Government grantee 
carrying out NAEP operations, devised a new way to describe performance against this 
scale, called “anchor levels.” Starting in 1984, NAEP results were reported by “anchor 
levels.” Anchor levels describe distributions of performance at selected points along the 
NAEP scale (i.e., standard deviation units). Anchor levels show how groups of students 
perform relative to each other, but not whether this performance is adequate. 

In 1988, Congress established the National Assessment Governing Board (NAGB), 
assigning it broad policy making authority over NAEP, including the authority to take 
“appropriate actions ... to improve the form and use of the National Assessment” and to 
identify “appropriate achievement goals for each . . . grade and subject area to be tested in 
the National Assessment.” To carry out its responsibilities, NAGB developed 
“achievement levels,” which are collective judgments about how students should perform 
relative to a body of content reflected in the NAEP frameworks. The result is translated 
onto ranges along the NAEP scale. For the 1992 reading assessment, this process was 
conducted for NAGB under contract by American College Testing (ACT), which has 
extensive experience in standard-setting in many fields. 

With this background, the initial reports for the 1992 reading assessment mark NCES’s 
continued attempt to shift to standards-based reporting of National Assessment statistics. 
The first transition to reporting NAEP results by achievement levels was for the NAEP 
1992 Trial State Assessment in mathematics. 1 The impetus for this transition lies in the 
belief that NAEP data will take on more meaning for the public if they show what 
proportion of our youth are able to meet judgmental standards of performance. 

Reporting NAEP results on the basis of achievement levels represents a significant change 
in practice for NCES. On occasion, this agency makes use of emerging analytical 
approaches that permit new, and sometimes controversial, analyses to be done. When 
doing so, this agency, just as other statistical agencies do when introducing new measures 
to supplement or replace old measures, also has provided the data according to the earlier 
procedures in addition to the new ones. In the case of the 1992 mathematics assessment, 
for example, the “anchor levels” or “scale anchoring” method of reporting was presented 
in an appendix. 



1 For a summary of the 1992 assessment of mathematics, see NAEP 1992 Mathematics Report Card for the 
Nation and the States. (Washington, DC: National Center for Education Statistics, 1993) and the individual 
1992 Mathematics State Reports. 



advantage of new technologies and to reflect changing trends in education. In 1984, a new 
technology called Item Response Theory (IRT) made it possible to create “scale scores” 
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